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ABSTRACT 

Researchers have long been aware that "pretest 
sensitization" is a potential threat to the external validity of 
experimental studies. Only recently, however, has it been suggested 
r,hat "posttest sensitization" might also limit the generalizafaility 
of results. This latter phenomenon would exist to the extent that the 
effects of a treatment are latent and appear only when a posttest is 
administered. Under this condition, the treatment would work 
differently for subjects in the researcher's sample than for other 
individuals who might later receive only the treatment without the 
accompanying posttest. To be scientifically useful, it is imperative 
that the hypothesis of posttest sensitization be capable of empirical 
ver if icat ion.r and a guasi-experimental design is proposed for this 
purpose . (Author) 
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Researchers have long been aware that '^pretest sensitization" is a potential 
threat to the external validity of experimental studies. Only recently, however, 
has it been suggested that "posttest sensitization" might also limit the general- 
izability of results. This latter phenomenon would exist to the extent that the 
V effects of a treatment are latent and appear only when a posttest is administered, 
f Under this condition, the treatment would work differently for S^s in the research- 
( er's sample than for other individuals who might later receive only the treatment 
without the accompanying posttest. To be scientifically useful, it is imperative 
that the hypothesis of posttest sensitization be capable of empirical verification, 
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and a quasi-experimental design is proposed for this purpose. 
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OBJECTIVE 

In 1968, Bracht tx Glass published an article in which they extended Campbell 
& Stanley *s ri963) discussion of external validity. In this paper, liracht 6: Glass 
suggest that in addition to pretest sensitization, it is possible that posttest 
sensitization may limit the degree to which the results oC a study can be general- 
ized. The present paper has been v;ricten to propose a nev? quasi-experimental de- 
sign which can be used to determine empirically whether or not the results of a 
study can be generalized beyond the subjects used by the researcher to other indi- 
viduals who V7ill not be tested following exposure to the treatment. 

THEORETICAL FRAMEWORK 

Researchers have long been aware that the generalizabili ty of results from ex- 
periments which involve a pretest may be limited by a possible interaction between 
the pretest and the treatment. Referred to as "test reactivity" by Campbell &. Stan- 
ley (1963), this particular threat to external validity would be present to the ex- 
tent that the pretest sensitizes subjects (S^s) to the forthcoming treatment, causing 
them to react to the treatment differently than x^70uld a similar group of individuals 
who are not pretested. For a researcher who wants to determine empirically whether 
or not a pretest interacts V7ith his treatment, the Solomon (1949) four-group design 
coupled with a two-way analysis of variance of the posttest scores provides a direct 
test of a possible pretest sensitization. 

Recently, Bracht 6^ Glass (1968) have suggested that in addition to pretest sen- 
sitization, it is possible that posttest sensitization could limit the degree to 
which the results of a study can be generalized. Posttest sensitization, as a threat 
to external validity, would exist to the extent that the posttest provides "cues" to 
Ss such that the effect of the treatment is more pronounced for individuals who are 
posttested than it would be for others who are not tested following exposure to the 
treatmenu. 

Although the problem of posttest sensitization can be circumvented by using an 
''unobtrusive measure'^ (Webb, Campbell, Schwartz, 6^ Sechrest, 1966) as the posttest, 
the nature of the treatment variable in most research studies precludes the use of 
this type of dependent variable. Thus, there is a need for a research design that 
can be employed to ascertain whether the treatment of a study would be as effective 
for a non-posttested population as it is for the specific Ss in the researcher's 
sample who did, in fact, receive a posttest. This paper has been written to propose 
such a design. 

THE NEW DESIGN 

Suppose a researcher takes his available S_s and randomly assij\ns them to four 
groups. Two of the groups are exposed to the treatment while the other two are not, 
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thus creating*, two experimental grou})S and two control ).jroups. Following com])] ct ion 
of the treatment, post test //I is administered to one of tiie cixpcrimcntal j.;roups and 
one of the control groups. Finally, posttest il2 is administered to all four groups. 
In terms of a diagram, the proposed design for investigating posttest sensitization 
would appear as follows: 



R X 0^ 0^ 




with R designating random as'signment of S^s to the four groups, X representing the 
trc::iment, 0^ symbolizing the first posttest, and 0^ symbolizing the second post- 
test. 

The data from the second posttest (0^) could be analyzed by means of a two-way 
MOVA, with the two factors being (a) treatment vs. no treatment, and (b) exposure 
vs. non-exposure to the first posttest. This statistical analysis would provide 
three F-ra ties , one related to the main effect of the treatment variable, one related 
to the main effect of the first posttest, and one related to the interaction between 
the treatment and the first posttest. The interpretation of a significant treatment 
main effect would be s traightf orvjard ; it would indicate that who are exposed to 
the treatment perforin differently (on 0^) than do _Ss who are not exposed to the treat- 
ment. Likewise, a significant main effect for the first posttest would be eaily in- 
terpreted. A significant F here would indicate that Ss who receive the first posttest 
perform differently on the second posttest than do S^s who are not exposed to 0^, and 
the phenomenon of "testing" (Campbell & Stanley, 1963) would be the explanation. 

Tlie third JF-ratio provides information as to whether or not there is an inter- 
action between X and 0- . If this interaction is significant, it would indicate that 
the effect of the treatment, as shov;n by subject performance on 0 , varies according 
to whether or not the S^s are exposed to the first posttest. In other words, if the 
first posttest sensitizes the _Ss to the treatment, in a retroactive manner, then the 
F-ratio for the interaction would turn out to be significant. 



DISCUSSION 



The research design that is described above is very similar to the Solomon four- 
group design in that the interaction F^-ratio provides a test of the potential threat 
to external validity, pretest sensitization in the Solomon design and posttest sensi- 
tization in the proposed design. In addition, S^s are randomly assigned \ ■. the four 
groups in both designs, thus insuring high internal validity. In spite of these 
similarities, Solomon* s design is considered to be a "true experimental" design where- 
as the design being proposed in this paper can only be classified as a "quasi- 
experimental" design. The latter design must be classified in this manner because 
it provides only partial, rather than complete, verification of a possible posttest 
sensitization. 

Ideally, posttest sensitization should he investigated by comparing (a) a group 
of S^s who are exposed to both the treatm.ent and a subsequent posttest, with (b) an- 
other group of S^s who are exposed to tho treatment:, but not the posttest. If the 
posttest were to interact with the treatment, the first group would he expected to 
Drofit more (or possibly less) from exposure to the treatment than would the second 
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group wyiich does not receive the posttest. However, it would be logically impossible 
to compare tbe two groups to see whether they differ, for no data are collected from 
the second group of . Since there is no v.'ay to assess the effect of having one 
posttest as compared with ixo post Lest, the only possible recourse is to compare the 
degree to which posttest sensitization exists v;hen there are two posttects as coin- 
pared w^ith just one posttest, and the proposed quasi-experimental design does just 
this* 

If this design demonstrates that the effectiveness of the treatment varies 
according to v;hethor one or tv;o posttosts are administered, then the researcher • can 
probably assume that the treatment 'will also have a different effect when it is not 
followed by any posttest v;hatsoever. Hence, a significant interdiction from the pro- 
posed design would indicate that caution should be used in generalising statements 
about the treatment (assuming a significant treatment main effect) to individuals who 
will not be given a posttest. The. direction of the difference between the second 
posttest (0^) means for the two experimental groups will allov; the researcher to make 
an educated guess as to whether the treatment will work better (or not as well) with 
the untested population from which the sample of _Ss was drawm. 

If the interaction from the proposed design turns out tc be non-significant, the 
researcher should not automatically assume that posttest sensitization is non-existent. 
Suppose that, for a particular study, posttest sensitization is an "all-or-none" phe- 
nomenon that takes place instantaneously, as in an "ah^ha'^ insight, upon exposure to 
a posttest. The first experimental group would experience posttest sensitization 
w^hen administered 0 , and the later administration of 0^ vjould not help to increase 
further the apparent effectiveness of the treatment. Tne second experimental group, 
when exposed to their only posttest (0^), V70uid be expected to experience the same 
degree of posttest sensitization as the first experimental group did when given 0 . 
Under these conditions, the interaction from the two-v;ay ANOVA would turn out to Be 
non-significant, even though posttest sensitization does exist. 

Although it is important to acknowledge the possibility that the proposed design 
might fail to pick up an existent posttest sensitization, the present authors believe 
that the situation described in the preceding paragraph is not typical nor very real- 
istic. Even though some insights are definitely of an '*ah-ha" nature, individuals 
tnost certainly gain the insight at different rates. It seems highly probable that 
some S^s would need the assistance (impetus) of both posttests before gaining the in- 
sight, and thus the average performance of S^s in the first experim.ental group would 
be higher on 0^, their second posttest, than the average performance of S_s in the 
second experimental group on the same dependent variable, 0^ being their first post- 
test. With sufficient pov;er, the proposed design xjould reveal this difference be- 
tween the two experimental groups. 

In conclusion, the notion of posttest sensitization is a highly plausible hypo- 
thesis. It is essential, however, that this hypothesis be capable of experimental 
verification, for as Helmstadter (1970) points out, "to set up a nontestablc hypo- 
thesis is to remove the problem from the realm of science, and any conclusions drawn 
under these circumstances will have to be based on faith, no science (p. 15),'* Be- 
cause of an inevitable Heissenberg effect, the quasi-experimental design that has 
been proposed in this paper provides only an ap])roximate test of the hypothesis. Un- 
til a better procedure is developed, however, this particular research design is 
worthy of consideration. 
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